Recent work on few-shot learning [1,2,3] shows that simply fine-tuning a well-trained feature extractor outperforms prior meta-learning methods. I think this phenomenon is not limited to the few-shot classification/detection but is a general problem of machine learning: that most (if not all) problems can be formulated as the two-step (input- feature, feature- output) approach. I feel that a pretty large amount of the "method" papers are stuck in the local minima or revisiting the known observation to the slightly different settings. In my understanding, the machine learning problems essentially break down into the 1) representation learning (input- feature) and 2) prediction (feature- output) problems, hence any proposed "method" paper should outperform the combination of the SOTA feature extractor and the SOTA prediction network (e.g., MoCo/SimCLR cosine classifier for few-shot classification). However, frustratingly few papers provide such a good ablation study.